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Abstract 

The prospects of detecting neutral Higgs bosons in the minimal supersymmetric 
model via their decays into muon pairs at the LHC are investigated. The CMS 
detector performance is adopted for a realistic study of observability. It is found that 
the muon pair decay mode might provide a very promising channel to search for the 
neutral Higgs bosons of minimal super symmetry. This channel will allow precise mass 
reconstruction for neutral Higgs bosons. 
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1 Introduction 



One of the most important experimental goals of future hadron supercolliders such as the 
CERN Large Hadron Collider (LHC) is to unravel the mystery of electroweak symmetry 
breaking, to produce and to detect the Higgs bosons or to prove their non-existence. In 
the Standard Model (SM) of electroweak interactions, only one Higgs doublet is required 
to generate masses for fermions as well as gauge bosons. One neutral CP-even Higgs boson 
(H°) appears after spontaneous symmetry breaking. Various extensions of the SM have 
more complicated Higgs sectors and lead to additional physical spin zero fields Q. 

The minimal supersymmetric extension of the Standard Model (MSSM) || has two 
Higgs doublets with vacuum expectation values V\ and t>2- After spontaneous symmetry 
breaking, there remain five physical Higgs bosons: a pair of singly charged Higgs bosons H ± , 
two neutral CP-even scalars H (heavier) and h (lighter), and a neutral CP-odd pseudoscalar 
A. The Higgs sector is strongly constrained by supersymmetry so that at the tree level, 
all Higgs boson masses and couplings are determined by just two independent parameters, 
which are commonly chosen to be the mass of the CP-odd pseudoscalar (Ma) and tan (3 = 
vz/vi. 

Since the top quark is very heavy [[| |J, radiative corrections from large t-quark Yukawa 
couplings substantially modify the tree level formulae for masses and mixing patterns in the 
Higgs sector. Several groups have reevaluated prospects for the detection of MSSM Higgs 
bosons at future hadron colliders. Most studies have focused on various SM decay modes 
for the neutral Higgs bosons, <ft ~ > 77 an d 4> — > ZZ or ZZ* — > 41 (<ft = H,h and A) ; as 
well as for the charged Higgs boson H, that are detectable above background. Parameters 
were selected such that supersymmetric particle (SUSY particle) masses were large so that 
Higgs boson decays to SUSY particles were kinematically forbidden ||-[[l(J. A region of 
parameter space roughly spanning pseudoscalar Higgs mass Ma ~ 100 — 300 GeV and ratio 
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of Higgs VEV's tan (3 ~ 4 — 10 where none of the SM decay modes were detectable. For 



large tan (3, the rf decay mode (JTOJ, [11], [T2[ has been suggested to be a promising discovery 
channel. Recently, it has been argued that neutral Higgs bosons might be observable via 
their bb decays [[13], [L4], in a large region of the (Ma, tan (3) plane, provided that sufficient 



6-tagging capability can be achieved. Signals for invisible decays of Higgs bosons have also 
been considered [Oj-p^]. In addition, there are regions of parameter space where rates 
for Higgs boson decays to SUSY particles are large and dominant. While these decays 
reduce the rates for SM signatures, making conventional detection of Higgs bosons even 
more difficult, they also open up a number of new promising modes for Higgs detection 



In this paper, the prospects of discovering the neutral Higgs bosons in the MSSM via 
their decays into muon pairsf] at the LHC are investigated. Parton level calculations are 
presented in Section II. The CMS detector performance is adopted for a realistic study of 
observability. Results from realistic simulations are discussed in Section 3 and promising 
conclusions are drawn in Section 4. 

2 Parton Level Calculations 

In our analysis, the cross section of pp — > <fi — > /i/i + X is evaluated from the Higgs boson 
cross section a(pp — > <fi + X) multiplied with the branching fraction of the Higgs decay 
into muon pairs B(<f) — > fifi). The parton distribution functions of CTEQ2L |23| are chosen 
to evaluate the cross section of pp —>■ <p + X with A 4 = 0.190 GeV and Q 2 = M| + 
where Pt is the transverse momentum of the Higgs bosons. We take Mz = 91.187 GeV, 
sm 2 6 w = 0.2319, M w = M z cos6 W} m b = 4.7 GeV, and m t = 175 GeV. We have included 
one loop corrections from top and bottom Yukawa interactions to the Higgs masses and 
couplings using the effective potential p4|-|26| with A t = A\ ) = 0. The contributions from 



3 This discovery channel may not be useful to search for the SM Higgs boson 
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the D-terms are usually small [22|, therefore, they are not included. We consider two sets 
of parameters similar to those discussed in Ref. ||22|| , (a) m g = rriq = \x = 1000 GeV, 
such that the Higgs boson decays to SUSY particles are kinematically forbidden; and (b) 
rrig = rriq = fi = 300 GeV, such that the Higgs boson decays to SUSY particles are large 
and dominant when tan/5 is less than about 10. The K- Factors are not included for the 
signal or the background. 

At the LHC energy, the SM Higgs boson (H°) is produced dominantly from gluon fusion 
p7|j , and from vector boson fusion [P8]-||30|| if the Higgs boson is heavy. In the MSSM, gluon 
fusion (gg —>■ 0) is the major source of neutral Higgs bosons for tan/? less than about 4. If 
tan j3 is larger than about 10, neutral Higgs bosons in the MSSM are dominantly produced 
from 6-quark fusion (bb — > 0) We have evaluated the cross section of Higgs bosons 

in pp collisions a(pp — > + X), with two dominant subprocesses: gg — > and gg — > <pbb. 
The cross section of gg — > <pbb is a good approximation to the 'exact' cross section j31 



of bb — > for less than about 500 GeV. In addition, the subprocesses gg — > 4>bb and 
gg — > #0 are complementary to each other for producing large Pt Higgs bosons at future 



hadron colliders [32, |33], 34]. Since the Yukawa couplings of <fibb are enhanced by 1/ cos/3, 
the production rate of neutral Higgs bosons is usually enhanced with large tan/3. For 
Ma larger than about 150 GeV, the couplings of the lighter scalar h to gauge bosons and 
fermions become close to those of the SM Higgs boson, therefore, gluon fusion is the major 
source of the h even if tan f3 is large. 

If the bb mode dominates Higgs decays, the branching fraction of <fi — > [i\x is about 
(m^/mb) 2 . It has been found that QCD radiative corrections reduce the decay width of 
— > bb by a factor of about 2 ]35, 36fl. Therefore, the branching fraction of — > [ip, is about 
2 x 10 -4 when the bb mode dominates. Let's consider a parameter space of (M^, tan/3) 
with 50 GeV <M A < 500 GeV and 1 < tan/3 < 35. The branching fraction of B(h -> up) 
in the whole parameter space as well as B(A — > fift) and B(H — > /x/2) with tan/3 ^ 10 is 
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always about 2 x 10~ 4 , even when A and H can decay into SUSY particles. For Ma less 
than about 80 GeV, the H decays dominantly into hh, AA and ZA. 

Fig. 1 shows the cross section of pp — ► <f> — > ///2 + X as a function of M4 for various 
values of tan/?. We have taken rriq — p — 1 TeV. For tan /3 ^ 10, the production cross 
section is always enhanced. As expected, the cross section of pp — > h — > /i/i + X does not 
change much with tan /3 for M4 > 150 GeV. Also shown is the same cross section for the 
SM Higgs boson H° with M H o = M A . For M H o > 140 GeV, the SM H° mainly decays into 
gauge bosons, therefore, the branching fraction B(H° — > up) drops sharply. 

We define the signal to be observable if the 99% confidence level upper limit on the 
background is smaller than the corresponding lower limit on the signal plus background 
[|, 0, namely, 



where L is the integrated luminosity, and is the background cross section within a bin 
of width ±AM^ centered at M<f>; N = 2.32 corresponds to a 99% confidence level and 
N = 2.5 corresponds to a 5cr signal. 

To study the observability of the muon discovery mode, we consider the background 
from the Drell-Yan (DY) process, qq — > Z, 7 — > fip, which is the dominant background. We 
take AM^fx to be the larger of the CMS muon mass resolution or the Higgs boson width. 
The minimal cuts applied are (1) Pt(a0 > 10 GeV and (2) \ri(fi)\ < 2.5, for both the signal 
and background. More details about the background will be discussed in next section. 

The 5<T discovery contours at y/s = 14 TeV are shown in Fig. 2, for (a) L = 100 
ft," 1 , n = m ~ q = 1000 GeV, (b) L = 100 fb" 1 , \i = m~ q = 300 GeV, and (c) L = 10 fb _1 , 
fi = rriq = 1000 GeV. The A might be detectable in a large region of parameter space with 
tan/? away from one. The H might be observable in a region with Ma > 120 GeV and 
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tan j3 ^ 10. The h might be observable in a region with Ma < 120 GeV and tan /3 ^ 4. This 
channel is affected by the SUSY decay modes only slightly for H and h |38 |. The lighter 



top squarks will make the H and h lighter and enhance the Hbb coupling while reducing 
the hbb coupling. Therefore, the discovery region of H — > fip is slightly enlarged for a 
smaller Ma, but the observable region of h — > ftp is slightly reduced. 

3 Realistic Simulations 

Like the 77 mode, the discovery potential of the \x\x channel is very sensitive to the detector 
performance. Therefore, one needs to fix some detector model for quantitative estimates. 
The CMS detector performance parameters are used in our analysis to estimate the signal 
and backgrounds. The CMS will be one of two general purpose LHC detectors, and the 
very precise muon momentum reconstruction is one of its main parameters, which define 



the detector design [f[2| . Thus, it will be an excellent detector to look for the narrow 
di-muon resonances. 

3.1 Calculation tools 



We use PYTHIA 5.7 and JETSET 7.4 generators |9| with the CTEQ2L |3j parton dis 



tribution functions to simulate events on the particle level. In the case of DY background 
near the Z-peak, QED corrections are very important and have been taken into account 
by treating the Z — > up, decay with the computer program PHOTOS 



In addition to gg — > 0, the new debugged PYTHIA |^T| allows one to use gg — 
process for the production of all neutral MSSM Higgs bosons. The generated kinematics and 
total cross sections are in reasonable agreement with analytical parton level calculations. 
For our purpose we adapted in PYTHIA the program calculating 1-loop corrected masses 
and couplings f42fl . The PYTHIA/JETSET/PHOTOS outputs are processed with the 



CMS JET program |T43| . It is developed for fast simulations of "realistic" CMS detector 



response. The resolution effects are taken into account by using the parametrizations 
obtained from the detailed GEANT [[14] simulations. CMSJET includes also some analysis 
programs, in particular, a set of jet reconstruction algorithms, etc. 

For future analysis, all muons with transverse momentum Pt(^) > 5 GeV and pseu- 
dorapidity < 2.4; missing transverse momentum $f T ; central jets with transverse 

energy Et > 40 GeV and \r]\ < 2.4 are reconstructed and stored for each generated event. 

3.2 Backgrounds and optimal kinematical cuts 

There are several SM physical processes that generate sizeable muon pairs^. However, 
analyzing them process by process, one can conclude, that there is only one dominant 
subprocess in the interesting mass range (50 GeV < M^p < 500 GeV), which is the DY 
muon pair production |45[]. For low < 100 GeV the bb background is also potentially 



dangerous, but it can be reduced easily well below the DY process with isolation cuts on 
muons. The background from top quark pairs (ti) is negligible in the region — Mz\ < 
30 GeV. It is about 20 times smaller than the DY for ^150 GeV and begins to compete 
with the DY for the highest M^. About 90% of muon pairs in ti production are generated 
from the decay chain ti — > WWbb — > fiuflubb. For comparison, the event rate from WW is 
3-5 times lower than that from ti. 

To optimize the kinematical cuts, sizeable (~ 10 6 ) background event samples are gen- 
erated using the production chain described above. Our analysis indicates, that, in fact, 
after is constrained in a small bin around some fixed (we are looking for the nar- 
row states), there are no further suitable kinematical cuts to suppress the dominant DY 
background. So here some minimal cuts, providing good signal efficiency and acceptance 

are used: Pt(^) > 10 GeV with rj(fi) < 2.4. The ti background can be reduced nearly by 

4 SUSY backgrounds from the lightest chargino pairs and from the second lightest neutralino decays are 
currently under investigation. In our analysis, we assume that they could be reduced significantly with a 
cut on missing transverse energy, similar to the tt decays. 
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a factor of 5 with additional cuts: missing transverse energy Ifi T < 50 GeV, Nj et < 1 for 
jets with E T > 40 GeV, and \rj(jet)\ < 2.4. The muon isolation reduces the bb background 
by a factor of about 100. 

3.3 Results 

The invariant mass distribution (da/dM^p) of the backgrounds from (a) Drell-Yan, (b) 
W + W~ , (c) ti, and (d) bb, are shown in Fig. 3. 

Fig. 4 shows the 5<r significance contour for CMS detector and L = 100 fb -1 with 
minimal cuts discussed above and isolation criteria applied for low masses [M^mu < 85 
GeV). In this figure, we have considered the total cross section of pp — > </> — > fifi + X, 
summed over the h, the H and the A. For Ma ^ 200 GeV and tan (3 > 25 — 30, an 
integrated luminosity of 10 fb _1 would be sufficient to obtain Higgs signals with a statistical 
significance larger than 7. But in the region close to the Z- peak, the signal is marginal 
despite the large significance, because it appears on the shoulder of the huge Z- peak. Only 
an adequate subtraction procedure, if it would be possible, enables one to extract the signal 
in this region. 

Despite the high di-muon mass resolution of CMS detector (about 0.5% for M^p ~ 100 
GeV and better than 2% for M^<500 GeV), for large tan/3 ~ 30 one can obtain the 
unresolved (h,A) signal for Ma ^5 120 GeV or (H,A) signal for higher Ma, because the mass 
difference between the (h,A) or (H,A) Higgs bosons is several hundreds MeV, i.e. a factor 
of 10 less than Higgs widths. Only for the lowest accessible tan/5 ~ 10 — 15 it seems to be 
possible to resolve the signals for two resonances. But the signal become not so significant. 
Fig. 5 illustrates the signal over the backgrounds as function of M^p at ^Js = 14 TeV with 
an integrated luminosity of 100 fb" 1 , Ma = 80, 150 GeV, and tan/3 = 30. This figure is 
generated from a simulation with the CMS performance and rriq = fi = 1000 GeV. 
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4 Conclusions 



It is found that the muon pair decay mode can be a very promising channel to discover the 
neutral Higgs bosons of minimal supersymmetry. The discovery region of the might be 
slightly smaller than the rr channel but it will allow precise reconstruction for the Higgs 
boson masses. The A might be observable in a large region of parameter space with tan (3 
away from one. The H might be detectable in a large region with Ma > 120 GeV and 
tan/5 > 10. The h might be observable in a region with Ma < 120 GeV and tan/5 ^4. 

For Ma < 200 GeV and tan/3 > 25, L = 10 fb _1 would be enough to obtain Higgs 
boson signals with a statistical significance larger than 7. For M^ close to the M Z) the 
signal is marginal despite the large significance, because it appears on the shoulder of the 
huge Z peak. Adequate subtraction procedures are required to extract the signal in this 
region. One attractive possibility is to tag the fe-jets accompanying the /ip, from the Higgs 
decay, since the production rate of Higgs bosons via gg — > <pbb is large. With high 6-tagging 
efficiency and purity, we can reduce the dominant DY background to the level of Z + bb 
production. In this case, the tt background may become dangerous, and the additional 
cuts discussed above may be crucial. This signature is currently under study. 
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Figures 

FIG. 1 The total cross section of pp — > — > //// + X in fb, as a function of M^, with 
= 14 TeV, m t = 175 GeV, mf = p = 1000 GeV, and tan/3 = 1, 3, 10, and 30, for (a) 

the H, (b) the h and (c) the A. The cross section of pp — ^ H — > ///i + X for the SM Higgs 

boson is also presented with M H o = Ma- 

FIG. 2 The LHC discovery contours in the Ma versus tan/5 plane, for the H (solid), the 
h (dash) and the A (dot). Three cases are considered: (a) L = 100 fb" 1 , fx — rriq — 1000 
GeV, (b) L = 100 fb -1 , // = rn q = 300 GeV, and (c) L = 10 fb" 1 , // = m ? - = 1000 GeV. 
Other parameters are the same as in Fig. 1. The discovery regions are on the upper plane 
of the the parameter space. 

FIG. 3 Invariant mass distribution (da/dM^) of the background from (a) Drell-Yan, 
(b) W + W~, (c) it, and (d)bb. 

FIG. 4 The discovery contour in the Ma versus tan/3 plane, for the MSSM Higgs bosons 
via their muon pair decay mode, at y/s = 14 TeV with an integrated luminosity of 100 
fb -1 . This figure is generated from a simulation with the CMS performance and rriq — (j, — 
1000 GeV. We have considered the total cross section of pp — > — > /i/i + X, summed over 
the H, the h, and the A. The QED radiative corrections to background from the Drell-Yan 
process are included. The discovery region is on the upper plane of the the parameter 
space. 

FIG. 5 Histograms of number of events as a function of M^ for the signal and the 
background at y/s = 14 TeV with L = 100 fb -1 , M A = 80, 150 GeV, and tan/3 = 30. This 
figure is generated from a simulation with the CMS performance and rriq — fj, — 1000 GeV. 
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